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ABSTRACT 

In 1996 the National Science Foundation undertook a 
review of comprehensive curriculum projects in middle school science. 
The purpose of this document is to highlight the framework for the 
review developed to examine the middle school materials and the 
results of the panel's findings. Findings indicate that 13 of the 19 
projects examined had panel ratings of three or higher on the 1-5 
point scale of the Inverness Research Framework for Review, with 1 as 
"low" and 5 as "high" on overall quality. Topics discussed include 
content, pedagogy, assessment, equity, and implementation. Key 
findings include: (1) most materials do not explicitly address 
strategies for improving the performance of a diverse set of students 
through attention to differences in ability, learning style, etc.; 

(2) among the content areas. Earth Science appears least frequently; 

(3) connections between science and mathematics were not developed in 
most of the materials; (4) the weakest area in the set of materials 
relative to the science standards is lack of sufficient focus on the 
history and nature of science; and (5) too few materials incorporate 
significant and appropriate use of instructional technologies such as 
ensuring that the materials are presented in a variety of formats. 
Appendices contain the framework for the review and descriptions of 
each set of the instructional materials that are discussed in this 
report. (JRH) 
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PREFACE 



In 1996 the National Science Foundation (NSF) undertook a study of comprehensive (at 
least one year) instructional materials for science in the NSF portfolio encompassing the 
middle school years. This middle school review was the first effort to examine a range of 
projects for a particular set of grades. This paper describes both the process and the 
results of that study. 

One of the major goals of NSF is to provide the field with high quality instructional 
materials that incorporate the best research on teaching and learning, include accurate 
science and the active participation of scientists in the development process, and have 
undergone an extensive pilot and field test process. Support of such materials enables 
teachers, schools, and districts to have access to materials that provide students with the 
experiences that will lead to an understanding and mastery of scientific concepts and 
processes. 

The Division of Elementary, Secondary, and Informal Education (ESIE) in the 
Directorate for Education and Human Resources supports the development of 
instructional materials for grades K-12. The program staff of ESIE hope that this 
publication will be useful to teachers, science supervisors, and other administrators 
responsible for making curriculum decisions for their schools and districts. 

The ESIE program officers who worked on this study are Janice Earle, James Ellis, 

M. Patricia Morse, Gerhard Salinger, Joseph Stewart, and Emma Walton. For further 
information please contact: 

Janice Earle 
Program Director 

Division of Elementary, Secondary, 
and Informal Education 
National Science Foundation 
Room 885 

4201 Wilson Boulevard 
Arlington, VA 22230 
(703) 306-1614 
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National Science Foundation 

Review of Instructional Materials for Middle School Science 



In 1996, the National Science Foundation (NSF) undertook a review of comprehensive 
curriculum projects in middle school science. As work on the study progressed, it 
became clear that the framework for review developed to examine the middle school 
materials and the results of the panel’s findings might be helpful beyond NSF, and could 
be useful for those in the field working to improve science education in schools, districts, 
and states. The purpose of this paper is to make such information available to this 
broader audience. 

Introduction 

Unlike earlier school reforms, current reforms focus on identifying what all students 
should know and be able to do. Efforts such as NSF’s Systemic Initiatives aim to create 
bold new visions of curriculum, assessment, and pedagogy to improve education for all 
children. The frameworks for these reforms are often found in national standards such as 
those from the National Council of Teachers of Mathematics (NCTM), and the National 
Academy of Sciences’ National Science Education Standards (NSES). These national 
frameworks were largely grass roots efforts with contributions from teachers, parents, 
school administrators, and scientists and mathematicians. They represent consensus 
views on what content is most important to teach, suggestions for teachers about effective 
instructional strategies, suggestions for how to assess student learning, and in the case of 
the NSES, suggestions for implementation. In addition, the American Association for the 
Advancement of Science (AAAS) has developed Benchmarks for Science Literacy, a 
compendium of specific science literacy goals developed by scientists and educators that 
states, districts, and schools can use as a guide for a science curriculum. 

Many states and districts have developed curriculum frameworks in mathematics and 
science that build on or adapt these standards efforts. The question now is, do we have 
the tools required to successfully transverse the new educational terrain? The national 
standards and state frameworks perhaps set the compass and provide a large-scale map, 
but it falls on districts, schools, and teachers to identity the best materials and programs 
to make reform a reality. Without quality instructional materials even the best teachers 
can make little headway. 

To investigate the current status of instructional materials, NSF conducted a review of its 
portfolio of comprehensive curricula for middle school science (grades 5-9) in early 1996. 
The justification for starting with middle level science included the following: 

• Earlier NSF funded projects had resulted in several sets of comprehensive materials at 
the elementary level. 

• There were questions both in the field and at NSF about the availability of quality 
comprehensive materials for middle school students. 
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• There were several sets of middle school materials at or near completion, and 
therefore ready for review. 

The purpose of the Middle School Science Study was to answer the following questions: 

1 . What are the characteristics of the portfolio of comprehensive instructional materials for middle 
school science developed with NSF funds? 

2. How sufficiently do these materials provide for a comprehensive program for middle school 
science consistent with the national standards for science education? 

The study included a review of comprehensive curricula, those that equal a year or more 
of course material, produced during the past decade or that were currently under 
development. The central criteria used in reviewing the instructional materials were as 
follows: 

1 . Is the science content correct? 

2. How well do the materials provide for conceptual growth in science? 

3. How well do the materials align with the National Science Education Standards? 

Rationale and Background 

Overview and History of NSF’s Instructional Materials Development Program 
(IMD) 

It is NSF’s goal to “achieve excellence in U.S. science, mathematics, engineering and 
technology education at all levels .” 1 One of the strategies to meet this goal is to fund 
development of high quality instructional materials with potential for national impact that 
are consistent with state and national standards. NSF, through the IMD Program, 
supports the development of new comprehensive materials, development of new 
instructional units, and revisions of existing high quality materials. 

Developing high quality instructional materials is an expensive and long-term process, 
requiring contributions from numerous teachers, scientists, and mathematicians to ensure 
that the content and pedagogy are current and correct. Materials should contain activities 
that are engaging and relevant for students, and provide sufficient guidance for teachers 
so that they can be implemented successfully in classrooms. Materials must provide for 
extensive pilot and field testing with diverse student populations, and this often means 
time-consuming revisions. Materials supported by NSF are often under development for 
five or more years before they are ready for publication. High quality instructional 
materials are a critical component of the reform effort. Reform is not possible without 
materials that contain cutting-edge science, provide for students’ conceptual growth over 
time, and contain engaging reading, experiments, and opportunities for teacher-directed 
and student inquiry. 



1 NSF in a Changing World, National Science Foundation, Arlington, V A (NSF95-24). 
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